Interactive educational system and method

ABSTRACT

A method of presenting an interactive story including displaying an illustration on a display without a corresponding narrative; receiving a user&#39;s input; determining whether the user&#39;s input corresponds to at least one word in a hidden narrative associated with the illustration; and displaying the word in the hidden narrative on the display in response to determining that the user&#39;s input corresponds to the word.

FIELD OF THE INVENTION

The present invention relates generally to educational systems andmethods, and more particularly relates to a method of participating inan interactive story with illustrations and corresponding hiddennarratives that are only revealed in response to a user's input, such astyping in and/or audibly reciting words from the hidden narrative.

BACKGROUND OF THE INVENTION

It is well-known that educators encourage reading as providing manysubstantial benefits to both children and adults, such as, vocabularyexpansion, developing language skills, and learning about varioustopics. In fact, reading is one of the primary methods of educatingtoday. Unfortunately, reading is not highly interactive. On thecontrary, it is a rather passive activity where words are observed bythe human eye, interpreted by the human brain, and stored away.Creativity is required to write a story, but not much is required toread it. There is very little creativity and interactivity that isrequired through passive reading. Studies have shown that interactivelearning improves critical thinking skills, and develops imagination andlogic skills more than passive learning. Interactive learning also helpswith retention and memory and is sometimes considered more entertainingand engaging than passive learning techniques.

To increase the level of interactivity and engagement in books, someeBooks have incorporated features, such as 3-D animated graphicillustrations, and options to click on illustrated characters or objectsto receive an audible message from the character or other additionalinformation. However, these features are actually not much moreinteractive than reading, merely requiring clicking and viewing. Thesefeatures do not require a higher level of involvement, such as requiringthe reader to participate in the storytelling process, to fully engagethe attention of the reader, requiring the reader to pay close attentionto details of the illustration and allowing the reader to participate inthe creative storytelling process.

Therefore, a need exists to overcome the problems with the prior art asdiscussed above.

SUMMARY OF THE INVENTION

The invention provides an interactive educational system and method thatovercomes the hereinafore-mentioned disadvantages of theheretofore-known devices and methods of this general type.

With the foregoing and other objects in view, there is provided, inaccordance with the invention, a method of associating a multi-wordnarrative with an illustration, the method including displaying anillustration without a corresponding narrative; receiving a user'sinput; determining whether the user's input corresponds to at least oneword in a hidden narrative associated with the illustration; anddisplaying the word in the hidden narrative in response to determiningthat the user's input corresponds to the at least one word.

In accordance with another feature of the present invention, the user'sinput includes an utterance of the word.

In accordance with a further feature of the present invention, thehidden narrative describes only viewable features of the illustration.

In accordance with a further feature of the present invention, theillustration is formed as a single still image.

In accordance with yet another feature of the present invention, theillustration is formed as a sequence of still images.

In accordance with another feature of the present invention, theillustration is formed as a video.

In accordance with a further feature of the present invention,displaying the illustration further comprises displaying theillustration on a display for a predetermined time period.

In accordance with the present invention, a method of learning includesviewing an illustration on a display without a corresponding narrative;and determining a hidden narrative associated with the illustration byinputting at least one word from the hidden narrative such that the wordbecomes viewable on the display in response to inputting the word.

In accordance with the present invention, an education method includesproviding an illustration configured to be viewable by a user without acorresponding narrative; and creating a hidden narrative describing onlyviewable features of the illustration, where each of a plurality ofwords in the hidden narrative is configured to become viewable inresponse to a user's input of said word.

In accordance with the present invention, a system for presenting aninteractive story is provided, the system including a display; a speechrecognition module configured to receive at least a portion of anutterance, analyze the portion of the utterance, and identify a wordcorresponding to the portion of the utterance; a processing devicecommunicatively coupled to the display and the speech recognitionmodule. The processing device is configured to execute computerinstructions, the computer instructions including instructions fordisplaying an illustration on the display without a correspondingnarrative; and displaying on the display at least one word of a hiddennarrative associated with the illustration in response to the speechrecognition module identifying the word as corresponding to a user'sutterance.

Although the invention is illustrated and described herein as embodiedin an interactive story system and method, it is, nevertheless, notintended to be limited to the details shown because variousmodifications and structural changes may be made therein withoutdeparting from the spirit of the invention and within the scope andrange of equivalents of the claims. Additionally, well-known elements ofexemplary embodiments of the invention will not be described in detailor will be omitted so as not to obscure the relevant details of theinvention.

Other features that are considered as characteristic for the inventionare set forth in the appended claims. As required, detailed embodimentsof the present invention are disclosed herein; however, it is to beunderstood that the disclosed embodiments are merely exemplary of theinvention, which can be embodied in various forms. Therefore, specificstructural and functional details disclosed herein are not to beinterpreted as limiting, but merely as a basis for the claims and as arepresentative basis for teaching one of ordinary skill in the art tovariously employ the present invention in virtually any appropriatelydetailed structure. Further, the terms and phrases used herein are notintended to be limiting; but rather, to provide an understandabledescription of the invention. While the specification concludes withclaims defining the features of the invention that are regarded asnovel, it is believed that the invention will be better understood froma consideration of the following description in conjunction with thedrawing figures, in which like reference numerals are carried forward.The figures of the drawings are not drawn to scale.

Before the present invention is disclosed and described, it is to beunderstood that the terminology used herein is for the purpose ofdescribing particular embodiments only and is not intended to belimiting. The terms “a” or “an,” as used herein, are defined as one ormore than one. The term “plurality,” as used herein, is defined as twoor more than two. The term “another,” as used herein, is defined as atleast a second or more. The terms “including” and/or “having,” as usedherein, are defined as comprising (i.e., open language). The term“coupled,” as used herein, is defined as connected, although notnecessarily directly, and not necessarily mechanically. The term“providing” is defined herein in its broadest sense, e.g.,bringing/coming into physical existence, making available, and/orsupplying to someone or something, in whole or in multiple parts at onceor over a period of time.

As used herein, the terms “about” or “approximately” apply to allnumeric values, whether or not explicitly indicated. These termsgenerally refer to a range of numbers that one of skill in the art wouldconsider equivalent to the recited values (i.e., having the samefunction or result). In many instances these terms may include numbersthat are rounded to the nearest significant figure. In this document,the term “longitudinal” should be understood to mean in a directioncorresponding to an elongated direction of the display. The terms“program,” “software application,” and the like as used herein, aredefined as a sequence of instructions designed for execution on acomputer system. A “program,” “computer program,” “softwareapplication,” or “computer instructions” may include a subroutine, afunction, a procedure, an object method, an object implementation, anexecutable application, an applet, a servlet, a source code, an objectcode, a shared library/dynamic load library and/or other sequence ofinstructions designed for execution on a computer system.

BRIEF DESCRIPTION OF THE DRAWINGS

The accompanying figures, where like reference numerals refer toidentical or functionally similar elements throughout the separate viewsand which together with the detailed description below are incorporatedin and form part of the specification, serve to further illustratevarious embodiments and explain various principles and advantages all inaccordance with the present invention.

FIG. 1 is a process flow chart representing an exemplary method ofpresenting an interactive story, in accordance with an embodiment of thepresent invention;

FIG. 2 is a screenshot of an exemplary software application at leastpartially implementing the inventive process, the screenshot depictingan illustration with a hidden narrative presented on a display of acomputing device in accordance with the present invention;

FIG. 3 is a screenshot of the exemplary software application of FIG. 2depicting a revealed word corresponding to an utterance/input by a userin accordance with the present invention;

FIG. 4 is a screenshot of the exemplary software application of FIG. 2depicting a visual clue including a leading question displayed to theuser in accordance with the present invention;

FIG. 5 is a screenshot of the exemplary software application of FIG. 2depicting a revealed word corresponding to an utterance/input by theuser in response to the visual clue in FIG. 4 in accordance with thepresent invention;

FIG. 6 is a screenshot of the exemplary software application of FIG. 2depicting a revealed word corresponding to a software feature thatreveals verbs in accordance with the present invention;

FIG. 7 is a screenshot of the exemplary software application of FIG. 2depicting a visual clue including an underline of hidden words inaccordance with the present invention;

FIG. 8 is another process flow chart representing an exemplary method oflearning, in accordance with an embodiment of the present invention;

FIG. 9 is yet another process flow chart representing an exemplarymethod of storytelling, in accordance with an embodiment of the presentinvention;

FIG. 10 is a block diagram of an exemplary electronic device, inaccordance with an embodiment of the present invention;

FIG. 11 is a block diagram of a data processing system on which thesoftware application of FIG. 2 may run, in accordance with an embodimentof the present invention;

FIG. 12 is a screenshot of another exemplary software applicationimplementing an inventive electronic flash card depicting anillustration of a first step in a medical procedure with a hiddennarrative in accordance with an embodiment of the present invention;

FIG. 13 is a screenshot of the exemplary software application of FIG. 12depicting the illustration of the first step in the medical procedurewith revealed words corresponding to a user's utterance/input inaccordance with an embodiment of the present invention;

FIG. 14 is a screenshot of the exemplary software application of FIG. 12depicting an illustration of a second step in the medical procedure witha hidden narrative in accordance with an embodiment of the presentinvention;

FIG. 15 is a screenshot of the exemplary software application of FIG. 12depicting the illustration of the second step in the medical procedurewith revealed words corresponding to a user's utterance/input inaccordance with an embodiment of the present invention;

FIG. 16 is a screenshot of the exemplary software application of FIG. 12depicting an illustration of a third step in the medical procedure witha hidden narrative in accordance with an embodiment of the presentinvention;

FIG. 17 is a screenshot of the exemplary software application of FIG. 12depicting the illustration of the third step in the medical procedurewith revealed words corresponding to a user's utterance/input inaccordance with an embodiment of the present invention;

FIG. 18 is a screenshot of another exemplary software applicationimplementing another inventive electronic flash card depicting theillustration in the form of a textual visual representation with ahidden narrative in the form of a legal definition in accordance with anembodiment of the present invention;

FIG. 19 is a screenshot of the exemplary software application of FIG. 18depicting the illustration with a revealed word corresponding to theuser's utterance/input in accordance with an embodiment of the presentinvention;

FIG. 20 is a screenshot of another exemplary software applicationimplementing an inventive foreign language electronic flash carddepicting the illustration in the form of a textual visualrepresentation in a foreign language with a hidden narrativecorresponding to a translation in a native language in accordance withan embodiment of the present invention; and

FIG. 21 is a screenshot of the exemplary software application of FIG. 20depicting the illustration with revealed words corresponding to theuser's utterance/input in accordance with an embodiment of the presentinvention.

DETAILED DESCRIPTION

While the specification concludes with claims defining the features ofthe invention that are regarded as novel, it is believed that theinvention will be better understood from a consideration of thefollowing description in conjunction with the drawing figures, in whichlike reference numerals are carried forward. It is to be understood thatthe disclosed embodiments are merely exemplary of the invention, whichcan be embodied in various forms.

The present invention provides a novel and efficient method ofpresenting an interactive story that requires a user to participate inthe storytelling process. Embodiments of the invention provide fordisplaying an illustration to the user with a hidden narrative andallowing the user to make observations of objects in the illustrationand inferences from the illustration, such as emotion of the characters,to unveil words in the hidden narrative. In addition, embodiments of theinvention provide for a user input module, such as a speech recognitionmodule that is able to determine whether audible utterances by the usercorresponds to one or more hidden words in the hidden narrative, whichresults in unveiling of the hidden word(s). In another embodiment, theuser input module is configured to receive textual user input throughtyping, rather than audible user input. The inventive process developsattention skills, especially in children, by requiring them to pay closeattention to objects and allows users to develop a story throughdetailed observations of the illustration. The inventive process alsodevelops writing skills, grammar, sentence building, and storytellingskills and can be particularly useful as a language learning tool.

Referring now to FIG. 1, one embodiment of the present invention isshown in a process flow chart. FIG. 1 shows several advantageousfeatures of the present invention, but, as will be described below, theinvention can be provided in several shapes, sizes, combinations offeatures and components, varying numbers and functions of thecomponents, and can be performed in varying sequences and with differentintermediary steps. The first example of a process for presenting aninteractive story, as shown in FIG. 1, will be described in conjunctionwith FIGS. 2-7, which depict screenshots from an exemplary softwareapplication that may implement the inventive process. As used herein,the term “interactive” is defined as involving input from a user. Theprocess flow starts at step 100 and moves directly to step 102 where anillustration is displayed on a display without a correspondingnarrative. As used herein, the term “illustration” is defined as avisualization or a depiction, such as a drawing, sketch, painting,photograph, cartoon, video, computer graphic, or other kind of visualrepresentation, whether still or dynamic, of things seen, remembered, orimagined, including a graphic depiction of words, text, and punctuationmarks. In one embodiment, the illustration is formed as a single stillimage. As used herein, the term “still image” is intended to indicateany static visual representation, such as a sketch, photograph, drawing,painting, or the like. In another embodiment, the illustration is formedas a sequence of still images, such as, for example, a cartoon or otheranimation. In yet another embodiment, the illustration is formed as avideo, such as, for example, a short video clip or television clip thatcan be used to prompt the user to recite the corresponding narrative bymaking observations of and inferences from the video or television clip.

In a preferred embodiment, the illustration is associated with adescriptive narrative; however, the narrative is not displayed initiallyto a user, which provides the user with a chance to create the storyhimself, using the illustration as a guide. As used herein, the term“display” is defined as an electronic device for the visual presentationof data. In one embodiment, the display is a computer monitor. Inanother embodiment, the display is a television monitor. In yet anotherembodiment, the display is formed as a touchscreen of an electronicmobile device, such as a smart phone, a computer tablet, an e-Reader, orthe like. As used herein, the term “corresponding narrative” is intendedto indicate a narrative that is associated with and/or describes theillustration.

Referring to FIG. 2, an exemplary illustration 200 is presented withouta corresponding narrative. It is noted that dotted line text appearsbelow the illustration 200, representing a hidden narrative that is notyet revealed to the user via the display. The exemplary illustration 200is formed as a green giraffe that is sitting. In one embodiment, theillustration is displayed on the display only for a limited,predetermined time period so as to require the user to make observationsquickly and through recollection. This option may be available in amedium or a hard setting to further challenge the user and improve theuser's memory. In one embodiment, a software application implementingone or more of the features described herein, can also include an easy,medium, and a hard setting that allows the user to tailor the difficultyto his desired level. In one embodiment, the predetermined time periodis less than or equal to approximately 60 seconds. In anotherembodiment, the predetermined time period is approximately 30 seconds.In yet another embodiment, the predetermined time period isapproximately 15 seconds. In further embodiments, the predetermined timeperiod is outside of these ranges. In another embodiment, the hardsetting has a longer predetermined time period than the medium and easysettings. In a further embodiment, the user can select the predeterminedtime period. In yet a further embodiment, the time period is determinedat random by the software application.

In step 104, the user's input is received. The user's input can bereceived through, for example, a user input interface, such as akeyboard, a mouse, or a touchscreen, or the user's input can be receivedthrough, for example, an audio input, such as a microphone. In oneembodiment, the display and user input interface (and/or audio input)can be communicatively coupled to an electronic device, such as acomputer tablet, a smart phone, a laptop, a personal computer, and thelike, on which the software application can run/operate. In anotherembodiment, the display and user input interface (and/or audio input)can be communicatively coupled to an electronic device dedicated topresenting stories/books in accordance with the present invention, suchas, for example, an e-Reader specifically dedicated to allowing users toread and interact with hidden text books of the present invention. Asused herein, the term “input” is intended to indicate any informationand/or data from the user that is put in or enters an electronic devicefor processing. In one embodiment, the input includes typedtext/characters that are entered by the user through, for example, akeyboard or a touchscreen. In another embodiment, the input includes anutterance of at least a portion of a word by the user, which is receivedvia a microphone. As used herein, the term “utterance” is defined as avocal expression. In yet another embodiment, the present invention caninclude a speech recognition module configured to receive at least aportion of the utterance, analyze the portion of the utterance, andidentify a word corresponding to the portion of the utterance. In thismanner, the speech recognition module can assist in converting analogaudio signals from the user to digital information that can be processedby a processor of the electronic device and used to implement one ormore of the features described herein on the electronic device. Infurther embodiments, the input can include other types of usercommunication methods.

In step 106, the electronic device determines whether the user's inputcorresponds to at least one word in the hidden narrative associated withthe illustration. As used herein, the term “corresponds” is defined as:to be substantially similar or equivalent, or to match. In oneembodiment, the speech recognition module determines whether the user'sutterance corresponds to a spoken word and the software applicationfurther determines whether the spoken word corresponds to a hidden wordin the hidden narrative. In another embodiment, the software applicationdetermines whether the user's typed textual input corresponds to ahidden word in the hidden narrative. As used herein, the term“narrative” is defined as including a spoken, written, printed, or othertextual account of related events, description, definitions,translations, and/or facts, real or imagined, and punctuation marks. Asused herein, the term “hidden narrative” is defined as a narrative thatis hidden from display with its corresponding illustration, but can bedisplayable with its corresponding illustration in response to theoccurrence of one or more user inputs. In one embodiment, the narrativecan include a portion of a fictional story, such as a children's storyor a novel. In another embodiment, the narrative can include a portionof a description of a factual or historical event or a scientific ormathematical understanding. In yet another embodiment, the narrative canbe formed as a portion of a story presented in a language other than aprimary language of the user, i.e. a foreign language. Accordingly,embodiments of the present invention can be used as an interactivelearning tool for learning foreign languages. In a further embodiment,the narrative includes one or more steps in a medical procedure. In yetanother embodiment, the narrative includes a definition and theillustration is a graphical representation of the word being defined bythe narrative. This can be considered a novel flash card embodiment ofthe present invention. Preferably, the narrative includes observations,descriptions, and inferences that can be made from the illustration.FIG. 2 illustrates an exemplary embodiment of a hidden narrative 202corresponding to the illustration 200. For illustrative purposes, inFIG. 2-7, the hidden narrative 202 is presented in a dotted line formatwhen the hidden narrative 202 is hidden, i.e. not displayed, and ispresented in normal black text when portions of the hidden narrative 202are revealed.

In step 108, the word in the hidden narrative is displayed on thedisplay in response to determining that the user's input corresponds tothe word. FIG. 3 presents a user interface where, in response to theutterance 300 of the word “giraffe,” the text GIRAFFE isrevealed/displayed beneath the illustration 200. In some embodiments,the exact wording is not required to reveal a word in the hiddennarrative. For example, if the root word (e.g. sit) is uttered/spoken,typed, or otherwise input by the user, the corresponding full word (e.g.sitting) in the hidden narrative may be revealed. In a foreign languagelearning embodiment, as the user makes observations of the illustration,via utterances or typed input, in the user's native language, the hiddennarrative is in a foreign language. For example, in response to theuser's utterance of “giraffe,” which is an English word, the hiddennarrative is revealed on the display in the foreign language equivalent,such as “jirafa,” which is the Spanish word for “giraffe.” In a furtherembodiment, in response to the hidden text being revealed, the softwareapplication also causes a computerized audio playback of the foreignlanguage word(s) as they are revealed, so that the user may hear theproper pronunciation and intonations and learn sentence building andspelling in the foreign language.

In one embodiment, punctuation is automatically revealed with theillustration 200. In another embodiment, punctuation is revealed onlywhen the word that immediately precedes or follows the punctuation isrevealed. For example, the sentence “A green giraffe is sitting outside”ends with a period. Accordingly, the period at the end of the sentencewould only be revealed as a result of the word “outside” being revealed,as the word “outside” immediately precedes the period. In yet anotherembodiment, punctuation is only revealed when the punctuation is utteredor typed in. For example, the period at the end of the sentence “A greengiraffe is sitting outside” would only be revealed when the user uttersor types in the word “period.” As another example, commas would only berevealed when the user utters or types in the word “comma.” In yetanother embodiment, punctuation is only revealed when the punctuation isuttered or typed with the word that immediately precedes thepunctuation. For example, in one embodiment, the period at the end ofthe sentence “A green giraffe is sitting outside” is revealed as aresult of the user uttering or typing in the words “outside period.” Inanother embodiment, commas are revealed, one at a time, when the userutters or types in the word “comma” with the word that immediatelyprecedes the comma. For example, the hidden text is “A bear, Teddy,loves ice cream.” Punctuation is revealed as a result of the useruttering or typing in the words “A bear comma Teddy comma loves icecream period.” Accordingly, users can learn proper punctuation. In yetanother embodiment, all punctuation is revealed as a result of the useruttering or typing in the word for the punctuation. For example, allcommas in the hidden text are revealed as a result of the user utteringor typing in the word “comma.”

In additional embodiments, the software application can include clues toassist the user with formulating the story from the illustration. In oneembodiment, clicking on an object reveals one or more hidden wordscorresponding to the selected object. In another embodiment, leadingquestions can be displayed to assist the user, such as, what is the beareating? Or, how many times should you push the patient's chest? FIG. 4shows an exemplary leading question clue 400, prompting the user toanswer as to what the giraffe is doing. The leading question clue 400 isin the form of a printed/visual question enclosed in a speech bubbledisplayed on the display proximate the illustration. In anotherembodiment, the leading question clue 400 can include a computerizeddigital signal from the electronic device simulating an audiblevocalized question.

FIG. 5 illustrates that, in response to the user's utterance 500 of theword “sitting,” the text SITTING is revealed/displayed within the hiddennarrative. In yet another embodiment, the clue can be an option toreveal particular words by classification, e.g. by noun, pronoun,adjective, verb, adverb, conjunction, proposition, interjection,punctuation, and the like. FIG. 6 illustrates an option where the verbs600 are revealed from the hidden narrative. In a further embodiment, theclue can include an underline of each unrevealed hidden word in thehidden narrative such that the user may observe the length and thenumber of words remaining in the hidden narrative.

FIG. 7 illustrates an option where the remaining unrevealed hidden wordsare underlined 700. In yet a further embodiment, the clue can include adistinct underline of each letter of each unrevealed hidden word in thehidden narrative such that the user may observe how many letters are ineach unrevealed hidden word. In another embodiment, if the user utters,types, or otherwise inputs a synonym for a hidden word in the hiddennarrative, a message is communicated, such as, “very close” or “almost,the word we're looking for begins with an S,” or some otherencouragement that the user is on the right track. In yet anotherembodiment, if the user utters, types, or otherwise inputs a synonym fora hidden word, the hidden word is revealed and a message iscommunicated, such as, “close enough,” or “these words are synonyms.” Inyet a further embodiment, the clue can be in the form of highlighting orpointing arrows towards objects or other visual aspects of theillustration that have not been observed and uttered by the user yet. Inone embodiment, the user can be presented with a list of clue types andthe user can select which clue type to activate. In another embodiment,the clues can be provided at timed intervals controlled by the softwareapplication. In yet another embodiment, the user can select a hard,medium, or easy setting, where, for example, no clues are provided inthe hard setting, some clues are provided in the medium setting, and allavailable clues are provided in the easy setting. In a preferredembodiment, the hidden narrative describes only viewable features of theillustration, not additional story elements that cannot be observed,inferred or otherwise discerned from the illustration. As used herein,the term “viewable features” is intended to indicate features that canbe observed, inferred, or otherwise discerned from the visual depictionprovided by the illustration. For example, the exemplary illustration200 (FIG. 2) shows a green giraffe sitting outside. Accordingly, anycorresponding hidden narrative would not include any discussion of ahouse, a tree, or any other additional story elements not observable orinferable from the illustration.

In one embodiment, for grammar learning purposes, the illustration willinclude the text as a non-hidden narrative viewable on the display,while the punctuation is hidden. In another embodiment, all the text ispresented in lower case so that the user is prompted to reveal thegrammatically proper text format as a result of the user uttering ortyping in the punctuation following the word that immediately precedesit. As an example, the illustration is displayed on the display toinclude the non-hidden text: “It was a nice and sunny day mama bear wasmaking pancakes as little bear was walking down the stairs.” Thegrammatically proper text and punctuation is revealed as a result of theuser uttering or typing in the words of the text, including the wordsfor the punctuation. For example, as a result of the user uttering ortyping in the following: “It was a nice and sunny day period,” a periodwill be revealed between the words “day” and “mama,” and the letter “m”in “mama” will change on the display to a capital letter “M” because ofthe grammatical rule that the first letter in a new sentence is alwayscapitalized. Further, as a result of the user uttering or typing in thefollowing: “mama bear was making pancakes comma as little bear waswalking down the stairs period,” the comma and period are revealed onthe display in the proper location, along with the text. Accordingly,users can learn proper grammar and punctuation.

In one embodiment, there may be a limited, predetermined number ofattempts to reveal punctuation, after which the software applicationwill prevent additional attempts, and/or present a score determined bythe amount of attempts and the number of correct punctuation marksrevealed. In another embodiment, the predetermined number of attemptsdepends on the level of complexity selected for a particular narrative,story, or session. For example, the hidden text may include ten commas,with fifteen total attempts allowed. In one exemplary embodiment, theillustration includes as viewable on the display the non-hidden text:“Marvin as he was known to those around him.” If the softwareapplication allows only a single attempt and the user utters or typesin: “Marvin as he was known comma to those around him” the user wouldreceive a failing grade or score and not be allowed any more attempts,because the proper grammar and punctuation is: “Marvin, as he was knownto those around him,” with the comma immediately following the word“Marvin.” As another example, an illustration including a 200 characternarrative may include 20 commas, with the user taking 30 attempts toreveal all 20 commas (or other punctuation). After the number ofattempts is depleted, the user may receive a score or a grade, such as60% or a C, for example, where the score is determined by the number ofattempts taken and/or the number of revealed punctuation marks and/orthe amount of time required to reveal all the punctuation marks. Theprocess ends at step 110.

Referring to FIG. 8, a process flow chart is presented for an exemplarymethod of using the software application, or of learning, in accordancewith the present invention. The process begins at step 800 andimmediately proceeds to step 802, where the user views the illustrationon the display without the corresponding narrative. In step 804, theuser determines the hidden narrative associated with the illustration byinputting at least one word from the hidden narrative such that the wordbecomes viewable on the display. As discussed above, the user makes thisdetermination by observing the illustration and making inferences fromthe illustration and uttering, typing, or otherwise inputting hisobservations in the electronic device operating the softwareapplication. After the user determines/reveals the hidden narrative forthe illustration by inputting each of the words in the hidden narrative,the user can scroll, tab, or swipe to the next page, where a secondillustration is displayed without its corresponding narrative, and theprocess may repeat until the hidden narrative for the last page isdetermined. In this manner, the user can participate in the entirestorytelling process from page to page by revealing the hidden narrativefor each subsequent illustration. In one embodiment, the presentinvention can include a timed aspect, where the time period to completethe story is recorded so that the user can try to improve his time insubsequent runs, or compare his time to other users times. The processends at step 806.

Referring to FIG. 9, a process flow chart is presented for an exemplarymethod of storytelling, in accordance with the present invention. Asused herein, the term “storytelling” is intended to mean conveyingrelated events, description, and/or facts, real or imagined, in wordsand/or still or dynamic images. The process begins at step 900 andimmediately proceeds to step 902, where an author provides anillustration configured to be viewable on a display without acorresponding narrative. In one embodiment, the author provides theillustration by obtaining the illustration from an artist that createsthe illustration. In another embodiment, the author creates theillustration himself through, for example, sketching, drawing, painting,using computer drawing tools, and the like. In step 904, the authorcreates a hidden narrative describing only viewable features of theillustration. Viewable features of the illustration can includeexpressly observable subjects or characteristics, such as a subject'sname, color, activity, clothing, location, and the like. Viewablefeatures of the illustration may also include observations that can beinferred or deduced from the illustration, such as an emotion of acharacter, where the illustration includes a smile, or a movement of thecharacter, where movement lines are included in the illustration. Eachof a plurality of words in the hidden narrative is configured to becomeviewable on the display in response to a user's input of said word. Inone embodiment, the author creates the hidden narrative by writing ortyping the hidden narrative describing detailed observable features ofthe illustration. In another embodiment, the author creates the hiddennarrative first and then, subsequently, the illustration is created orprovided to correspond to the hidden narrative such that each of theplurality of words in the hidden narrative is observable from theillustration. In some embodiments, the illustrations are fairlysimplistic, such as the sitting green giraffe depicted in FIGS. 2-7.These fairly simplistic illustrations may be included in, for example,younger children's hidden narrative stories, or for beginning foreignlanguage students. In other embodiments, the illustrations can be muchmore complex and involved, including multiple subjects and objects withvery detailed scenes. These more complex illustrations can be includedin, for example, more adult hidden narrative stories, or for advancedforeign language students. Creating stories from only viewable featuresof the illustrations is a novel and inventive new method ofstorytelling. The process ends at step 906.

It is understood that the process steps described in reference to FIGS.1, 8, and 9 are exemplary and are not intended to limit the presentinvention. Other embodiments may be implemented in a different sequence,some steps may be omitted for brevity, and some steps may occurconcurrently with one another.

Referring to FIG. 10, an exemplary electronic device 1000 is illustratedin a block diagram. The exemplary electronic device 1000 includes a userinput interface 1002, a network interface 1004, memory 1006, aprocessing device 1008, a display 1010, an audio input/output 1012, anda speech recognition module 1014. In one embodiment, the electronicdevice 1000 is a mobile electronic device, such as a computer tablet, asmart phone, a laptop, a dedicated e-Reader, or the like. In anotherembodiment, the electronic device 1000 is a personal computer.

The user input interface 1002 functions to provide a user a method ofproviding input to the electronic device 1000. The user input interface1002 may also facilitate interaction between the user and the device1000. The user input interface 1002 may be a keypad providing a varietyof user input operations. For example, the keypad may includealphanumeric keys for allowing entry of alphanumeric information (e.g.telephone numbers, contact information, text, etc.). The user inputinterface 1002 may include special function keys (e.g. a camera shutterbutton, volume control buttons, back buttons, home button, etc.),navigation and select keys, a pointing device, and the like. Keys,buttons, and/or keypads may be implemented as a touchscreen associatedwith the display 1010. The touchscreen may also provide output orfeedback to the user, such as haptic feedback or orientation adjustmentsof the keypad according to sensor signals received by motion detectors,such as an accelerometer, located within the device 1000.

The network interfaces 1004 may include one or more network interfacecards (NIC) or a network controller. In some embodiments, the networkinterface 1004 may include a personal area network (PAN) interface. ThePAN interface may provide the capability for the electronic device 1000to network using a short-range communication protocol, for example, aBluetooth communication protocol. The PAN interface may permit oneelectronic device 1000 to connect wirelessly to another electronicdevice 1000 via a peer-to-peer connection.

The network interfaces 1004 may also include a local area network (LAN)interface. The LAN interface may be, for example, an interface to awireless LAN, such as a Wi-Fi network. The range of the LAN interfacemay generally exceed the range available via the PAN interface.Typically, a connection between two electronic devices via the LANinterface may involve communication through a network router or otherintermediary device.

Additionally, the network interfaces 1004 may include the capability toconnect to a wide area network (WAN) via a WAN interface. The WANinterface may permit a connection to a cellular mobile communicationsnetwork, or the Internet. The WAN interface may include communicationscircuitry, such as an antenna coupled to a radio circuit having atransceiver for transmitting and receiving radio signals via theantenna. The radio circuit may be configured to operate in a mobilecommunications network, including but not limited to global systems formobile communications (GSM), code division multiple access (CDMA),wideband CDMA (WCDMA), and the like.

The electronic device 1000 may also include a near field communication(NFC) interface. The NFC interface may allow for extremely close rangecommunication at relatively low data rates (e.g., 424 kb/s). The NFCinterface may take place via magnetic field induction, allowing the NFCinterface to communicate with other NFC interfaces located on otherelectronic devices 1000 or to retrieve information from tags havingradio frequency identification (RFID) circuitry. The NFC interface mayenable initiation and/or facilitation of data transfer from oneelectronic device 1000 to another electronic device 1000 with anextremely close range (e.g. 4 centimeters).

Memory 1006 associated with the device 1000 may be, for example, one ormore buffer, a flash memory, or non-volatile memory, such as randomaccess memory (RAM). The electronic device 1000 may also includenon-volatile storage. The non-volatile storage may represent anysuitable storage medium, such as a hard disk drive or non-volatilememory, such as flash memory. In one embodiment, software instructionsassociated with the speech recognition module 1014 are stored innon-volatile memory and are executable by the processing device 1008. Ina further embodiment, the speech recognition module 1014 is configuredto receive at least a portion of a user's utterance, analyze the portionof the utterance, and identify a word corresponding to the portion ofthe utterance.

The processing device 1008 can be, for example, a central processingunit (CPU), a microcontroller, or a microprocessing device, including a“general purpose” microprocessing device or a special purposemicroprocessing device. The processing device 1008 executes code storedin memory 1006 in order to carry out operation/instructions of theelectronic device 1000. The processing device 1008 may provide theprocessing capability to execute an operating system, run variousapplications, and provide processing for one or more of the techniquesdescribed herein.

The display 1010 displays information to the user such as an operatingstate, time, telephone numbers, various menus, application icons,pull-down menus, and the like. The display 1010 may be used to presentvarious images, text, graphics, or videos to the user, such asphotographs, mobile television content, Internet webpages, and mobileapplication interfaces. In a preferred embodiment, the display 1010 isused to present illustrations and any revealed words from the hiddennarrative in accordance with the present invention. The display 1010 maybe any type of suitable display, such as an liquid-crystal display(LCD), a plasma display, a light-emitting diode (LED) display, or thelike.

The electronic device 1000 may include audio input and output structures1012, such as a microphone for receiving audio signals, e.g. utterances,from the user and/or a speaker for outputting audio data, such as audioalerts, songs, ringtones, video tracks, audio playback of the revealedtext, for example, for learning pronunciation in foreign languagelearning embodiments of the present invention, voice data received bythe electronic device 1000 over a cellular network, and the like. Theelectronic device 1000 may also include an audio port for connection toperipheral audio input and output structures, such as a headset, orperipheral speakers or microphones.

Referring to FIG. 11, a block diagram of a data processing system 1100that may also be implemented as an electronic device or other computingdevice, in accordance with one embodiment of the present invention. Thedata processing system 1100 may be a symmetric multiprocessor (SMP)system including a plurality of processors 1102 and 1104 connected tosystem bus 1106. Alternatively, a single processor system may beemployed. Also, connected to system bus 1106 is memory controller/cache1108, which provides an interface to local memory 1110. An I/O busbridge 1138 is connected to system bus 1106 and provides an interface toI/O bus 1112. The memory controller/cache 1108 and I/O bus bridge 1138may be integrated as depicted. The processor 1102 or 1104 in conjunctionwith memory controller 1108 controls what data is stored in memory 1110.The processor 1102 and/or 1104 and memory controller 1108 can serve as adata counter for counting the rate of data flow to the memory 1110 orfrom the memory 1110 and can also count the total volume of dataaccessed to or from the memory 1110. The processor 1102 or 1104 can alsowork in conjunction with any other memory device or storage location.

Peripheral component interconnect (PCI) bus bridge 1114 connected to I/Obus 1112 provides an interface to PCI local bus 1116. A number of modems1118, or wireless cards, may be connected to PCI bus 1116. Typical PCIbus implementations will support four PCI expansion slots or add-inconnectors. PCI includes, but is not necessarily limited to, PCI-X andPCI Express components. Communications links to a network of computers,such as the Internet, may be provided through the modem 1118 and networkadapter 1120 connected to PCI local bus 1116 through add-in boards.

Additional PCI bus bridges 1122 and 1124 provide interfaces foradditional PCI buses 1126 and 1128, from which additional modems ornetwork adapters may be supported. In this manner, the data processingsystem 1100 allows connections to a multiple network of computers. Agraphics adapter 1130 and hard disk 1132 may also be connected to I/Obus 1112 as depicted, either directly or indirectly.

Those of ordinary skill in the art will appreciate that the hardwaredepicted in FIG. 11 may vary. For example, other peripheral devices,such as optical disk drives and the like, also may be used in additionto or in place of the hardware depicted. The depicted example is notmeant to imply architectural limitations with respect to the presentinvention.

The processes explained in detail above can be embodied in a computerprogram. Computer programs (also called computer control logic) arestored in memory such as main memory 1110, removable storage drive 1134,removable media 1136, hard disk 1132, and signals. Such computerprograms, when executed, enable the computer system to perform thefeatures of the present invention as discussed herein. In particular,the computer programs, when executed, cause the processor 1102 and/or1104 to perform one or more of the features described herein.

In this document, the terms “computer program medium,” “computer usablemedium,” and “computer readable medium” are used to generally refer tomedia such as main memory 1110, removable storage drive 1134, removablemedia 1136, hard disk 1132, and signals. These computer program productsare means for providing software to the computer system. The computerreadable medium allows the computer system to read data, instructions,messages or message packets, and other computer readable informationfrom the computer readable medium. The computer readable medium, forexample, may include non-volatile memory, such as Floppy, ROM, Flashmemory, Disk drive memory, CD-ROM, and other permanent storage. It isuseful, for example, for transporting information, such as data andcomputer/programming instructions, between computer systems.Furthermore, the computer readable medium may comprise computer readableinformation in a transitory state medium such as a network link and/or anetwork interface, including a wired or wireless network, that allows acomputer to read such computer readable information.

Referring to FIGS. 12-17, another exemplary method of presenting aninteractive story is illustrated in a series of screenshots. Theexemplary method can be considered an interactive method of learning amedical procedure in accordance with an embodiment of the presentinvention. FIG. 12 shows a user interface displaying an illustration1200 without a corresponding narrative. The illustration 1200 depicts afirst step in a cardiopulmonary resuscitation (CPR) first aid medicalprocedure. It is noted that dotted line text appears below theillustration 1200, representing a hidden narrative that is not yetrevealed to the user via the display. FIG. 13 illustrates a user'sutterance 1300 of the words “tilt head,” resulting in a determinationthat the user's utterance 1300 corresponds to words in the hidden text.As a result, the words “tilt head” are displayed on the display, whilethe unspoken words “lift chin, and check breathing” continue to remainhidden.

FIG. 14 shows a second illustration 1400 without a correspondingnarrative. The second illustration 1400 depicts a second step in the CPRprocedure. It is noted that dotted line text appears below the secondillustration 1400, representing a hidden narrative that is not yetrevealed to the user via the display. FIG. 15 illustrates the user'sutterance 1500 of the word “breathe,” resulting in a determination thatthe user's utterance 1500 corresponds to a word in the hidden text. Inthis embodiment, the root word of “breaths” is “breathe,” therefore thehidden text BREATHS is displayed on the display, while the unspokenwords “give two” remain hidden. In one embodiment, the secondillustration 1400 is formed as an animated illustration where the personadministering CPR is animated to illustrate giving two breaths so thatthe user is able to infer such information from the illustration 1400.

FIG. 16 shows a third illustration 1600 without a correspondingnarrative. The third illustration 1600 depicts a third step in the CPRprocedure. It is noted that dotted line text appears below the thirdillustration 1600, representing a hidden narrative that is not yetrevealed to the user via the display. FIG. 17 illustrates the user'sutterance 1700 of the word “chest,” resulting in a determination thatthe user's utterance 1700 corresponds to words in the hidden text. As aresult, the word “chest” is displayed to the user, while the words“firmly push down on center of” and “15 times” remain hidden until theuser is able to input/utter each of the words in the hidden narrative.

FIG. 18 shows an illustration 1800 without a corresponding narrative.The illustration 1800 is a textual visual representation identifying alegal concept, namely a contract. It is noted that dotted line textappears below the illustration 1800, representing a hidden narrativethat is not yet revealed to the user via the display. FIG. 19illustrates the user's utterance 1900 of the word “offer,” resulting ina determination that the user's utterance 1900 corresponds to words inthe hidden text. As a result, the word “offer” is displayed to the user,while the words “acceptance,” “consideration,” and “mutuality” remainhidden until the user is able to input/utter each of the words in thehidden narrative. In other embodiments, the illustration 1800 may be amathematical formula, such as “10+10,” with the hidden text being theanswer to the mathematical formula, namely “20.” In yet otherembodiments, the illustration 1800 is a chemical formula, such as “H₂O,”with the hidden text being a description of the chemical formula, namely“two atoms of hydrogen and one atom of oxygen.”

FIG. 20 shows another exemplary illustration 2000 without acorresponding narrative. The illustration 2000 is a textual visualrepresentation foreign language sentences. It is noted that dotted linetext appears below the illustration 2000, representing a hiddennarrative that is not yet revealed to the user via the display. FIG. 21illustrates the user's utterance 2100 of the words “what is your name?”resulting in a determination that the user's utterance 2100 correspondsto words in the hidden text. As a result, the sentence “what is yourname,” which is an English translation of one of the foreign languagesentences, is displayed to the user, while the sentence “nice to meetyou” remains hidden until the user is able to input/utter each of thewords in the hidden narrative. In one embodiment, in response to thehidden text being revealed, the software application also causes acomputerized audio playback of the foreign language sentence so that theuser may hear the proper pronunciation and intonations.

A novel and efficient method of presenting an interactive story has beendisclosed that requires the user to participate in the storytellingprocess. Embodiments of the invention provide for displaying eachillustration to the user with a hidden narrative that the user mustreveal by making observations about the illustration and makinginferences from the illustration. In some embodiments, a speechrecognition module is used to determine whether audible utterances bythe user correspond to one or more of the words in the hidden narrative.The inventive process develops attention skills by requiring users topay very close attention to the details in the illustration and allowsusers to reveal the story through detailed observations of theillustration. The inventive process also develops writing skills,grammar, sentence building, and storytelling skills, while interactivelyengaging users in the story, as well as, provides an interactive methodfor foreign language learning and learning specific terminology andspecific subject matter.

What is claimed is:
 1. A method of associating a multi-word narrativewith an illustration, the method comprising: displaying an illustrationwithout a corresponding narrative on a display communicatively coupledto a memory; associating, by a processor, a plurality of words in ahidden narrative with the illustration; receiving, by a microphone, ananalog audio signal from a user representing a word spoken by the user;using a speech recognition module to convert the analog audio signal todigital data representative of the word spoken by the user; determining,by the processor, whether the digital data representative of the wordspoken by the user corresponds to one of the plurality of words in thehidden narrative associated with the illustration, the hidden narrativeincluding the plurality of words stored in the memory before receivingthe audio analog signal; and displaying on the display the word in thehidden narrative in response to determining that the digital datarepresentative of the word spoken by the user corresponds to the word inthe hidden narrative, while not displaying any of the plurality of wordsin the hidden narrative that do not correspond to the word spoken by theuser or a word previously spoken by the user.
 2. (canceled)
 3. Themethod in accordance with claim 1, wherein: the hidden narrativedescribes only viewable features of the illustration.
 4. The method inaccordance with claim 1, wherein: the illustration is formed as a singlestill image.
 5. The method in accordance with claim 1, wherein: theillustration is formed as a sequence of still images.
 6. The method inaccordance with claim 1, wherein: the illustration is formed as a video.7. The method in accordance with claim 1, wherein: displaying theillustration further comprises displaying the illustration on a displayfor a predetermined time period.
 8. A method of learning, the methodcomprising: presenting an illustration on a display without acorresponding narrative, the display communicatively coupled to amemory; receiving, by a microphone, an analog signal from a user, theanalog signal representing a word spoken by the user; using a speechrecognition module to convert the analog audio signal to digital datarepresentative of the word spoken by the user; determining, by theprocessor, a hidden narrative having a plurality of words associatedwith the illustration by associating at least one word from the hiddennarrative with the digital data such that the at least one word becomesviewable on the display in response to receiving the digital dataassociated with the at least one word, while any of the plurality ofwords in the hidden narrative that do not correspond to the digital datadoes not become viewable; and wherein the hidden narrative is stored inthe memory before the receiving of the digital data.
 9. (canceled) 10.The method in accordance with claim 8, wherein: the hidden narrativedescribes only viewable features of the illustration.
 11. The method inaccordance with claim 8, wherein: the illustration is formed as a singlestill image.
 12. The method in accordance with claim 8, wherein: theillustration is formed as a sequence of still images.
 13. The method inaccordance with claim 8, wherein: the illustration is formed as a video.14. A method of storytelling, the method comprising: providing, using adisplay of an electronic device, an illustration configured to beviewable by a user without a corresponding narrative; creating, by aprocessor of the electronic device, a hidden narrative having aplurality of words describing only viewable features of theillustration, where each of a plurality of words in the hidden narrativeis configured to become viewable in response to a of user speaking saidword, while any of the plurality of words in the hidden narrative thatdo not correspond to at least one word spoken by the user does notbecome viewable; wherein the hidden narrative is stored in a memorybefore the user's input of said word; receiving, by a microphone of theelectronic device, an audio signal representing a word spoken by theuser; using a speech recognition module of the electronic device toconvert the analog signal to digital data representative of the wordspoken by the user; causing, by the processor, a word in the hiddennarrative corresponding to the digital data to become viewable; andmaintaining the remaining words of the hidden narrative in a hiddenstate.
 15. (canceled)
 16. The method in accordance with claim 14,wherein: the illustration is formed as a single still image.
 17. Themethod in accordance with claim 14, wherein: the illustration is formedas a sequence of still images.
 18. The method in accordance with claim14, wherein: the illustration is formed as a video.
 19. A system forpresenting an interactive story, the system comprising: a displaycommunicatively coupled to a memory; a microphone configured to receivean audio signal representative of at least a portion of an utterance; aspeech recognition module configured to receive the audio signal,convert the audio signal to digital data, analyze the digital data, andidentify a word corresponding to the digital data; a processing devicecommunicatively coupled to the display and the speech recognitionmodule, the processing device configured to execute computerinstructions, the computer instructions including instructions for:displaying an illustration on the display without a correspondingnarrative; and displaying on the display at least one word of a hiddennarrative having a plurality of words associated with the illustrationin response to the speech recognition module identifying the word ascorresponding to the digital data, while any of the plurality of wordsin the hidden narrative that do not correspond to the digital data isnot displayed; and wherein the hidden narrative is stored in the memorybefore receiving the audio signal.
 20. The system in accordance withclaim 19, wherein: the hidden narrative describes only viewable featuresof the illustration.
 21. The system in accordance with claim 19,wherein: the processing device is configured to cause the illustrationto be displayed for only a predetermined amount of time.
 22. The systemin accordance with claim 19, wherein: the hidden narrative includes apunctuation mark, and wherein the processing device is configured toautomatically display the punctuation mark when a word preceding orfollowing the punctuation mark in the hidden narrative is displayed. 23.The system in accordance with claim 19, wherein: the processing deviceis configured to present a plurality of difficulty levels associatedwith the hidden narrative to the user, wherein the processing devicecauses the hidden narrative to be displayed for a first predeterminedamount of time when a first difficult level is selected and causes thehidden narrative to be displayed for a second predetermined amount oftime when a second difficulty level is selected.